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Abstract 

The  dissemination  of  scientific  results  and  new  technologies  in  biomedical  science  is  rapidly  evolving  from  an  exclusive 
and  fee-oriented  publishing  system  towards  more  open,  free  and  independent  strategies  for  sharing  knowledge.  In  this 
context,  preprint  servers  such  as  bioRxiv  answer  a  very  real  scientific  need  by  enabling  the  rapid,  free  and  easy 
dissemination  of  findings,  regardless  of  whether  these  are  novel,  replicated,  or  even  showcasing  negative  results. 
Currently,  thousands  of  manuscripts  are  being  shared  via  bioRxiv  each  month,  and  neuroscience  is  the  largest  and  fastest 
growing  subject  category.  However,  commenting  on  bioRxiv  is  declining  and  no  structured  scientific  validation  such  as 
peer-review  is  currently  available.  The  Peer  Community  In  (PCI)  platform  addresses  this  unmet  need  by  facilitating  the 
rigorous  evaluation  and  validation  of  preprints,  and  PCI  Circuit  Neuroscience  (PCI  C  Neuro)  aims  to  develop  and  extend  this 
tool  for  the  neuroscience  community.  Here  we  discuss  PCI  C  Neuro’ s  mission,  how  it  works,  and  why  it  is  an  essential 
initiative  in  this  new  era  of  open  science. 
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The  importance  of  preprints  for  the  dissemi¬ 
nation  of  scientific  findings 

Preprints  are  early  versions  of  scientific  manuscripts,  preced¬ 
ing  peer-review  and  final  publication  in  journals.  They  are 
posted  on  online  servers  that  are  freely  accessible  both  to  the 
scientific  community  and  to  the  general  public.  Many  such 
servers  exist,  supported  by  various  research  organisations,  that 
archive  preprints  for  different  scientific  fields  -  arXiv  for  maths 
and  physics,  chemRxiv  for  chemistry,  paleorXiv  for  paleontol¬ 
ogy,  bioRxiv  for  biology  and  very  recently  medRxiv  for  health 
sciences,  to  name  just  a  few.  Hence,  in  most  if  not  all  scien¬ 
tific  fields,  researchers  now  have  the  possibility  to  share  their 
findings  before  publication  thanks  to  preprints;  but  what  are 
the  advantages  of  doing  this? 

The  publishing  system  as  it  currently  stands  does  not  dis¬ 
seminate  scientific  findings  in  an  open  or  efficient  manner.  In¬ 
deed,  publisher-imposed  paywalls  prevent  not  only  the  public 
from  accessing  the  latest  research,  the  vast  majority  of  which 
is  in  fact  funded  by  public  money,  but  also  the  scientists  them¬ 
selves,  who  must  pay  both  to  publish  and  to  read  their  own 


articles.  While  the  recent  launch  of  the  ‘open  access’  publish¬ 
ing  initiative,  Plan  S,  is  beginning  to  challenge  this  system, 
the  cost  of  the  resultingly  mandatory  open  access  is  born  not 
by  the  publishers,  but  by  the  scientists  and  academic  institu¬ 
tions  who  must  often  pay  increasingly  larger  sums  in  order 
to  publish  their  work  free  of  paywalls  [1,  2].  Hence,  one  of 
the  main  advantages  of  preprints  is  in  enabling  the  free  dis¬ 
semination  of  scientific  findings.  A  second  important  benefit 
is  the  speed  at  which  these  findings  can  be  shared.  Indeed, 
a  preprint  becomes  accessible  to  all  within  just  a  few  hours 
of  its  initial  submission,  while  it  will  take  an  average  of  five 
months  to  a  year  to  publish  an  article  in  a  journal  [3,  4].  Un¬ 
surprisingly  then,  it  has  been  estimated  that  preprints  could 
accelerate  scientific  innovation  in  the  next  10  years  five -fold 
[5].  A  third  factor  is  the  visibility  of  research,  which  appears  to 
be  enhanced  by  preprinting,  with  articles  deposited  on  bioRxiv 
prior  to  publication  receiving  more  citations  and  attention  on 
social  media  than  those  going  directly  to  journals  [6].  Finally, 
preprints  are  providing  an  alternative  way  to  evaluate  scien¬ 
tists’  productivity,  with  most  large  funding  bodies,  such  as  the 
National  Institutes  of  Health  [7],  Wellcome  Trust  and  European 
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Figure  l.  The  need  to  have  an  evaluation  system  for  preprints.  (A)  Number  of 
preprints  and  comments  posted  on  bioRxiv  since  2014  (extracted  from  bioRxiv 
in  January  2018).  (B)  Demand  for  commenting  and  evaluation  of  preprints 
(survey  results  from  ASAPbio  2016  [8]  under  CC-BY  4.0.).  The  question  asked 
was,  “Would  a  system  of  commentary,  evaluation,  or  ratings  make  preprints 
potentially  more  valuable  for  the  community  (note:  this  is  not  a  current  feature 
of  arXiv)?” 


Research  Council,  to  name  a  few,  now  accepting  them  on  CVs 
for  grant  applications.  This  is  a  crucial  development,  as  pub¬ 
lishing  in  journals  currently  constitutes  the  most  important 
metric  of  academic  achievement,  and  early  career  researchers 
in  particular  are  thus  highly  dependent  on  this  painfully  slow 
process  to  obtain  career  advancement. 

Almost  40,000  preprints  were  deposited  on  bioRxiv  alone  by 
the  end  of  2018,  and  this  trend  shows  no  sign  of  slowing  down 
(Figure  lA).  It  is  becoming  clear,  then,  that  preprints  are  chang¬ 
ing  the  way  that  scientists  communicate  their  research,  both 
within  the  academic  community  and  with  the  general  public, 
from  a  fee-oriented  publishing  system  towards  a  free,  rapid 
and  open  dissemination  model.  However,  despite  the  many 
benefits  of  preprints  outlined  here,  it  is  apparent  that  one  im¬ 
portant  factor  could  further  enhance  their  utility:  scientific  dis¬ 
cussion  and  systematic  validation  of  the  presented  data. 


lA).  This  is  unlikely  to  be  due  to  saturation  of  users  available 
to  comment,  since  preprint  downloads  have  grown  commen- 
surately  with  their  uploads  [10].  Critically,  this  lack  of  com¬ 
menting  means  that  authors  are  still  having  to  rely  on  expen¬ 
sive  journals  for  feedback  and  input  on  ways  to  improve  their 
manuscripts,  and  that  while  some  journals  are  now  adopting 
open  peer-reviewing,  much  of  this  valuable  discussion  still  oc¬ 
curs  behind  closed  doors.  A  survey  conducted  by  ASAPbio  in 
2016  found  that  68%  of  392  participants  agreed  that  commen¬ 
tary,  or  some  form  of  evaluation  or  rating  system  for  biology 
preprints  would  be  valuable  for  the  community  (Figure  lB)  [8]. 
It  should  be  noted  that  the  respondents  may  have  a  potential 
bias  toward  open  science,  and  a  larger  survey  would  be  very 
useful.  However,  based  on  this,  it  seems  that  the  preprinting 
system  as  it  currently  stands  is  proving  essential  for  the  free 
and  rapid  dissemination  of  scientific  findings,  but  is  not  pro¬ 
viding  authors  with  the  feedback  and  discussion  they  need  to 
improve  and  advance  their  research. 


Scientific  validation  of  preprints:  the  “PCI  Cir¬ 
cuit  Neuroscience”  initiative 

In  a  traditional  publishing  model,  commentary  and  feedback 
from  the  scientific  community  exist  in  the  form  of  formal  peer- 
review,  which  importantly  serves  not  only  to  improve  the  qual¬ 
ity  of  the  scientific  research,  but  also  to  validate  the  findings. 
Preprints  typically  undergo  no  such  assessment,  making  it  dif¬ 
ficult  for  readers  to  distinguish  those  manuscripts  which  are 
scientifically  sound  from  those  that  are  not,  and  also  for  au¬ 
thors  to  demonstrate  the  quality  of  their  work  (i.e.  for  job  in¬ 
terviews  and  grant  applications).  While  it  is  unclear  what  is 
inhibiting  commenting  on  bioRxiv’ s  native  comment  field,  the 
need  for  systematic  scientific  commentary  and  validation  is  be¬ 
coming  more  recognised  and  new  platforms  for  preprint  peer- 
review  and  feedback  are  beginning  to  appear  and  gain  traction. 
Many  of  these  initiatives  are  listed  on  ASAPbio’ s  new  Reimag¬ 
ine  Review  site,  where  their  principal  functions  are  neatly  cat¬ 
egorized  into  three  domains:  (1)  curation  of  interesting  work, 
(2)  validation  of  soundness,  and  (3)  feedback  to  authors.  One 
such  initiative  is  Peer  Community  In  (PCI),  a  non-profit  organ¬ 
isation  that  focuses  on  the  latter  two  categories  by  providing  an 
open  peer-review  process  for  preprints.  PCI  works  by  bringing 
together  communities  of  researchers  to  review  and  recommend 
preprints  in  their  field  on  a  voluntary  basis,  thus  keeping  costs 
to  a  minimum  and  enabling  free  preprint  peer-review.  This, 
together  with  the  fact  that  authors  can  actively  submit  their 
work  for  review,  and  that  PCI  does  not  publish  the  articles  and 
thus  claims  no  exclusivity  over  them,  makes  PCI  a  truly  unique, 
community- driven  reviewing  platform,  fully  decoupled  from 
the  current  for-profit  publishing  system.  It  is  already  well  es¬ 
tablished  in  a  number  of  fields,  notably  evolutionary  biology 
and  ecology,  but  no  such  platform  currently  exists  for  the  neu¬ 
roscience  community,  despite  its  huge  potential  benefit. 


Lack  of  scientific  discussion  of  preprints 

Einstein  is  quoted  to  have  said  that  imagination  is  more  im¬ 
portant  than  knowledge,  and  -  in  a  chapter  on  imagination 
-  Beveridge  recommended  stimulating  the  mind  with  discus¬ 
sion  [9].  There  can  indeed  be  no  doubting  that  discussion  is 
beneficial  to  scientific  advancement,  and  the  more  open,  the 
better.  While  bioRxiv  does  provide  a  platform  for  such  dis¬ 
cussion  to  take  place,  it  seems  that  few  preprints  are  in  fact 
discussed  in  any  kind  of  detail.  Indeed,  although  thousands 
of  manuscripts  are  shared  on  bioRxiv  each  month,  the  com¬ 
menting  on  the  site  appears  to  have  reached  a  plateau  (Figure 


What  is  PCI  Circuit  Neuroscience? 

Neuroscience  constitutes  the  most  important  category  on 
bioRxiv,  featuring  the  greatest  number  of  preprints  both  sub¬ 
mitted  and  downloaded  since  the  site’s  launch  in  2013  [10]  (Fig¬ 
ure  2).  As  part  of  the  larger  PCI  initiative,  PCI  Circuit  Neuro¬ 
science  (PCI  C  Neuro)  will  bring  together  circuit  neuroscientists 
to  review  preprints,  with  a  particular  focus  on  the  following 
subject  areas:  neuronal  circuits,  assemblies,  oscillations,  neu¬ 
rophysiology,  synaptic  physiology  and  plasticity,  neuronal  bio¬ 
physics,  neuroanatomy,  neuropharmacology,  behavioural  neu¬ 
roscience  and  systems  neuroscience.  Of  course,  this  list  is  not 
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Figure  2.  Neuroscience  (thick  green  line)  is  the  largest  and  fastest  growing  subject  category  on  bioRxiv  as  measured  in  preprints  posted/month.  Other  subject 
categories  in  grey.  Figure  from  Rxivist  website  under  CC-BY  4.0  [10]. 


exhaustive,  and  PCI  also  welcomes  the  creation  of  additional 
PCI  platforms  specialising  in  other  subfields  of  neuroscience 
should  these  fall  outside  the  scope  of  PCI  C  Neuro. 

Our  mission  is  to  consider  all  submitted  preprints  that 
demonstrate  good  scientific  method  and  sufficient  data  to  sup¬ 
port  their  conclusions,  including  studies  replicating  previously 
published  work  and/or  showcasing  negative  results.  For  each 
recommended  preprint,  PCI  C  Neuro  will  publish  a  recommen¬ 
dation  text  and  the  full  reviewing  process.  In  addition,  a 
progress  page  logging  all  submissions  and  processing  timelines 
will  feature  on  the  website  for  added  transparency.  Finally,  PCI 
C  Neuro  will  deviate  slightly  from  the  original  PCI  template 
by  accepting  parallel  submissions  of  preprints  also  submitted 
elsewhere,  rather  than  requesting  that  authors  postpone  sub¬ 
mission  to  journals  until  the  PCI  review  process  is  complete. 
Importantly,  however,  we  aim  to  collaborate  with  journals, 
such  that  preprints  that  are  reviewed  and  recommended  by 
PCI  C  Neuro  may  subsequently  be  fast-tracked  for  publication 
should  the  journal  editors  be  satisfied  by  our  reviewing  stan¬ 
dards.  This  symbiotic  relationship  is  already  in  place  for  other 
PCI  platforms  and  a  number  of  journals,  and  we  look  forward 
to  building  our  own  collaborations  within  the  field  of  neuro¬ 
science,  starting  with  Neuroanatomy  and  Behaviour. 

How  does  PCI  C  Neuro  work? 

As  described  previously,  PCI  brings  together  communities  of 
researchers  to  peer-review  and  recommend  preprints  in  their 
field.  But  how  does  it  work  on  a  practical  level?  The  pro¬ 
cess  is  in  fact  very  similar  to  that  of  peer-review  for  a  tra- 
dional  journal,  with  the  exception  that  PCI  does  not  publish 
the  manuscript  at  the  end,  but  only  the  reviews  and  a  short 
recommendation  piece  explaining  the  importance  of  the  work 
(Figure  3).  In  brief,  after  having  uploaded  their  manuscript 
on  a  preprint  server  such  as  bioRxiv,  authors  can  submit  it  to 
PCI  C  Neuro  for  review.  If  the  work  is  considered  interesting 
by  one  of  the  many  PCI  C  Neuro  recommenders  (that  act  like 
journal  editors),  they  agree  to  manage  the  preprint  and  send  it 
out  for  review.  As  with  a  journal,  there  may  be  several  rounds 
of  review,  which  could  end  in  a  negative  or  positive  outcome. 
After  each  revision,  the  authors  will  upload  the  updated  ver¬ 
sion  of  their  mansucript  to  the  preprint  server,  until  the  rec- 


ommender  reaches  a  final  decision.  If  the  preprint  is  accepted 
for  recommendation,  the  recommender  writes  a  short  citable 
commentary  (the  recommendation),  which  is  published  along 
with  the  reviews  and  author  responses.  Reviewers,  but  not  rec¬ 
ommenders,  may  choose  to  remain  anonymous  if  they  wish. 

While  the  overall  concept  is  similar  to  journal  peer  review, 
the  key  difference  lies  in  building  a  large  community  of  recom¬ 
menders,  such  that  no  one  individual  must  bear  the  workload 
of  a  traditional  journal  editor;  PCI  recommenders  typically  han¬ 
dle  up  to  two  review  processes  per  year.  By  dividing  the  work¬ 
load  across  a  large  taskforce,  PCI  not  only  benefits  from  a  broad 
and  varied  pool  of  expertise,  but  also  allows  its  reviewing  ser¬ 
vices  to  remain  free  and  community- driven. 


Future  perspectives 

Physical  and  mathematical  sciences  are  the  forerunners  in 
preprinting  and  scientific  validation  outside  of  the  traditional 
publishing  system,  and  their  many  platforms  have  waxed  and 
waned  over  the  years  [11].  Perhaps  we  can  learn  from  them,  as 
the  evolution  of  preprints  in  biology  has  so  far  echoed  that  in 
physics.  Physics  platforms  were  typically  driven  by  single  indi¬ 
viduals,  and  often  peaked  within  two  years  from  launch  before 
disappearing  in  the  following  years  [11].  While  having  multi¬ 
ple  experimental  preprint  review  platforms  will  no  doubt  also 
benefit  the  field  of  biology  -  because  many  substitutable  op¬ 
tions  leads  to  a  healthier  publishing  ecosystem  [2]  -  we  should 
still  aim  for  sustainability:  to  establish  self-sustaining  sys¬ 
tems  of  self-organizing  peer-review,  dependent  on  and  run  by 
the  wider  community  rather  than  a  few  individuals  [12].  The 
key  in  our  view  consists  of  approval  by  the  field,  an  operating 
system  that  is  intuitive  and  easy  to  use,  low  workload,  ade¬ 
quate  mitigation  of  perceived  risks  to  reputation  and  journal 
submission  and  reliable  stewardship  far  into  the  future  under 
a  managing  board  that  is  refreshed  periodically.  We  hope  that 
PCI  in  general,  and  PCI  C  Neuro  in  particular,  will  help  to  drive 
this  new  era  of  open  science,  facilitating  the  free  and  efficient 
dissemination  of  validated  scientific  findings,  not  only  for  the 
scientific  community  but  also  for  the  general  public. 
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Figure  3.  Diagram  of  the  PCI  peer-review  and  recommendation  process. 
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